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Abstract 

We study systems without quenched disorder with a complex landscape, and we 
use replica symmetry theory to describe them. We discuss the Golay-Bernasconi- 
Derrida approximation of the low autocorrelation model, and we reconstruct it by 
using replica calculations. Then we consider the full model, its low T properties (with 
the help of number theory) and a Hartree-Fock resummation of the high-temperature 
series. We show that replica theory allows to solve the model in the high T phase. 
Our solution is based on one-link integral techniques, and is based on substituting a 
Fourier transform with a generic unitary transformation. We discuss this approach 
as a powerful tool to describe systems with a complex landscape in the absence of 
quenched disorder. 
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1 Introduction 



This note has been prompted by two main motivations. One comes from a problem whose 
solution has relevant practical applications, while the other one is more abstract in nature, 
and is generated from what we have learned in the last years about disordered systems [1,2]. 

We will be dealing with the problem of finding binary sequence with low autocorrela- 
tion [3, 4, 5]. Sequences of this kind are important in favoring efficient communication, 
and the practical side of the problem is obvious. We hope we will convince the reader it is 
also fascinating from a theoretic point of view. 

When we search binary sequences of +1 and —1 having minimal autocorrelation we 
are dealing with a completely deterministic problem, and disorder is not a part of the 
game. In our starting rules there is nothing random. Still, we will see how the system can 
indeed have a behavior that is very much reminiscent of a random system. Changing one 
spin to optimize a given set of correlations can increase other correlation functions, with 
a competitive effect which turns out to be typical of a system which contains disordered 
couplings. We will see that replica symmetry theory [1, 2] can be an useful tool even for 
describing this kind of systems. We will be able, by using the analogy with a relevant 
disordered system, to capture the general features of the model. We will try to understand 
and stress the differences which distinguish a low autocorrelation model from a spin glass 
like model. That will lead us to a detailed discussion of the low temperature properties of 
the low autocorrelation model. 

We present a careful investigation of some statistical mechanics aspects of the problem, 
by largely extending previous results due to Golay [4] and to Bernasconi [5] . We establish 
a relation between this deterministic problem and random spin glasses, which we consider 
a very interesting outcome of this study. Some ideas typical of spin glasses, as replica 
symmetry breaking, can be successfully used in this context. 

In section (2) we define the models we will discuss in the rest of the paper. In section 
(3) we discuss the ground state structure of the model (also by using well known number 
theory, see for example [6]) and we begin a discussion of its phase diagram and of the low 
temperature phase. In section (4) we discuss the validity of the Golay-Bernasconi approx- 
imation. We introduce the replica symmetry approach, we define a disordered model and 
we study its behavior. In section (5) we investigate in better detail the high-temperature 
regime. We perform and describe a high-temperature expansion. We introduce a Hartree- 
Fock approximation which allows us to write a closed form for the free energy. 

In section (7) we discuss the full phase diagram of the model. In section (6) we introduce 
one more model which can be solved by using the replica approach. The solution is the 
same we get with the Hartree-Fock approximation. In section (8) we draw our conclusions. 

The reader which will find this problem interesting will be happy to know that much 
related material is becoming available. Reference [7] mainly contains a study of the dy- 
namical properties of the system, which uses the tempering Monte Carlo approach [8] . Ref . 
[9] discusses aging in low autocorrelation models. Reference [10, 11] introduces and dis- 
cusses more models and analogies with random systems (and, in particular, the open low 
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autocorrelation model, see later). More results, which partially overlap with ours, will be 
discussed by Bouchaud and Mezard in [12]. 



2 Definition of the Model 

Let us consider a sequence of length N of spin variables Oj. They are labeled by a one- 
dimensional index j (aj, j = l,N), and can take the values ±1. The Hamiltonian is defined 
by 

1 N-l 

v^—^a, (i) 

iV 1 k=i 

where Ck is the sum of the <7j — Oj correlation functions at distance k = \i — j\. The choice 
of the boundary conditions, i.e. of the terms we will include in the sum (1), allows us to 
define two different models. 

• The open model is defined by using open boundary conditions. In this case C& is 
obtained by summing N — k terms: 

N-k 

C k= a i a i+k • ( 2 ) 

J'=l 

• The periodic model is defined by using periodic boundary conditions. Here we are 
considering a closed chain, and: 

N 

Ck = X (T i "(i+A:-l)(modAf)+l • (3) 
J'=l 

Here we have summed N contributions, considering all spin couples at distance k on 
the closed chain. 

The periodic model has some peculiarities which allow us to study it in greater detail. 
The main tool we will use is the Fourier transform. We can rewrite the periodic Hamiltonian 

as 

1 N 

H = -—T,mP)\ 4 -l) + l, (4) 

iV 1 p=i 

where the B{p) are the Fourier transformed <7j, and the Fourier transform is defined as 

1 N 

*(P) = -7=E^'V (5) 
j=1 
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In eq. (4) we had to subtract a constant factor since in the sum of eq. (1) we do not 
include the constant correlation at distance zero. 

In this paper we will focus on the periodic model. Further results about the open model 
will be contained in ref. [11]. 

As we have already discussed much attention has been devoted in the past to the 
problem of finding the ground state of such a model [3, 4, 5]. Here we will continue such an 
effort, but we will also (and mainly) extend our study to the thermo-dynamical behavior 
of the model. We will study its behavior as a function of the inverse temperature (3 = ^. 
Our main efforts will be devoted to the computation of free energy density. We define the 
partition function of our system as 

M/J) = 5>-^«*>> , (6) 
M 

where the sum runs over the 2 N allowed configurations of the spin variables, and the free 
energy density as 

f{(3) ee lim HZ N {(3))) . (7) 

Once again, we note that this approach has both a practical interest and a theoretical 
one. It is interesting to study the full thermo-dynamical behavior of the system since that 
gives more information about features of the low autocorrelation sequences. We will be 
interested for example in their number and their basin of attraction, and in their stability 
properties (which can be very relevant for practical applications). On the other side such a 
statistical mechanics approach will help us to shift towards the realm of disordered systems. 



3 The Ground State Energy and a First Look at Ther- 
modynamics 

The ground state of the periodic model defined by the Hamiltonian (1) (with Ck given by 
(3)) is not known in general. No systematic procedure to construct ground state configu- 
rations for generic N is known. A remarkable exception holds for given values of N, where 
ad hoc constructions exist. Such constructions are mainly based on number theory [6], and 
they produce spin sequences with a total energy of order 1, i.e. with an energy density 
e = ^ of order (which tends to zero in the thermo-dynamical limit). 

Let us describe a simple construction 1 , which works when N is a prime larger than 2 
[6]. We set the tjj variables to —1, or +1 by identifying 

o~j = j^-^mod N . (8) 

1 The same spin sequence can be obtained by using directly Legendre quadratic residues [6]. For all 
positive integer j < N we compute J = (j ■ j) (mod N), and we set uj = +1. In all locations but the 
7V-th one (where we set <jn — 0) that cannot be obtained through this procedure we set 07 = — 1. 
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In this way we get 2 <jj = ±1 for j < N, and ctjv = 0. For example for N = 13 by using 
this construction we get the sequence 

j 1 2 3 4 5 6 7 8 9 10 11 12 13 

<Tj +1 -1 +1 +1 -1 -1 -1 -1 +1 +1 -1 +1 

By following this procedure we have obtained a sequence which, but for its last spin, 
is a legitimate one (in the sense it is composed by ±1). Now we will proceed by first 
evaluating the energy of this quasi-legal sequence, and eventually by computing the effect 
of modifying the last spin to ±1, to get a truly legal sequence. We will show that such a 
sequence is in some cases a true ground state (i.e. it has the minimum allowed energy). 

Computing the energy of such a sequence is an easy task. Theorems well known by 
mathematicians [6] tell us that in this case all correlation functions Ck are equal to —1 (we 
remind the reader we are discussing the periodic model). We can also use a Gauss theorem 
[6] to notice that the Fourier transformed variables take here the form 

B(p) = G(N) a p , (9) 

where G(N) = 1 if the prime N has the form 4n + 1 (with positive integer n), and 
G(N) = —i if it has the form 4n + 3 (in different words on our sequences the Fourier 
transformed variables are equal or proportional to the original x-space variables). It is 
clear that the Hamiltonian (1) of the periodic model takes on our slightly-illegal spin 
sequence the value 1. 

Now we have to understand what happens when we modify the spin <7jv, by setting it 
to ±1. It is easy to see that when we do that the Hamiltonian changes of a finite amount. 
Indeed for N of the form 4n + 3 the Hamiltonian does not change, and keeps it value of 
1. The point is that (as can be easily verified by inspection) the ±1 sequences are in this 
case antisymmetric around the site N. For N of the form An + 1 the ±1 sequences are 
symmetric around the site N, and on the fully- legal sequence H takes a value of 5. 

Since we are considering N odd, it is clear that for N prime of the form 4n + 3 the two 
fully legal sequences we have built (and the sequences obtained by using the translational 
invariance of the problem, and the ±1 symmetry) are true ground states. This is because 
for N odd the minimum value allowed for each Ck is 1, and the minimum value allowed 
for if is 1. We have exhibited configurations with the minimal allowed energy, i.e. ground 
states. 

Let us state again our conclusion. In the case of iV prime of the form 4n + 3 we have 
obtained a thermodynamical ground state, whose energy density goes to zero when the 
volume goes to infinity. Translational invariance and spin flip invariance imply that the 
degeneracy of the ground state is at least 2N. 

For other values of N, for example of the form N = 2 P — 1, there are alternative 
techniques to construct the ground state, based for example on the theory of Galois fields 

2 A theorem by Fermat [6] tells us that if j is not a multiple of N than j( N ~^ = 1, mod N. Therefore 
in this case j2( N ~ x ) = ±1. 
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[6]. For example for N = 2 57 — 1 = 144115188075855871 one finds that the sequence which 
satisfies the relation 



(Tj_24Cj-57 



(10) 



is a ground state. If we exclude the trivial case of <7j identically equal to 1 (which is not a 
ground state), such sequence is unique, apart from a translation 3 [6, 13]. 

It is rather interesting to note that also in this case the Fourier transform is very similar 
to the original sequence. One finds that it exists a value of s such that 



The deep reasons for this duality among configuration and Fourier space escape us. 

It is quite remarkable that this last sequence is considered at all practical effects a good 
random sequence (see for example [13]). We can summarize the status of things by saying 
that the ground state of our model can be obtained as the output of a random number 
generator*. This is surprising, but maybe not so much. When designing a random number 
generator one wants bit sequences with low autocorrelation. That means that for large 
values of N the correlation functions should not be proportional to N. A true sequence 
of random numbers should have autocorrelations of order 7VX One is doing "better" than 
that by obtaining sequences with autocorrelation of order 1. That does not seem to cause 
any practical problem. 

For generic values of N we do not have any method to explicitly exhibit the ground state, 
and we do not know the ground state energy. The very existence of the thermodynamic 
limit is non trivial. One could get different results when N goes to infinity depending on 
the arithmetic properties of N sequence one selects. We shall see later that in the high- 
temperature region the iV -1 corrections are different for sequences consisting of even or 
odd values of N. The corrective terms proportional to N~ 3 also change depending if one 
selects an N series such that N is or not multiple of 3. We will see that in general things 
become more and more complex when we look at higher order corrections. 

In order to get the first hints about the ground states and the thermodynamical behavior 
of the system we have used two approaches. In first we have solved exactly (by computing 
the density of states by exact enumeration) systems of size up to N = 38. By examining all 
configurations we have computed the number of configurations of a given energy Af(E) as a 
function of E. We have looked at the ground state energy E , and stored and analyzed the 
ground state and the first excited state configurations (at least for some of the N values). 
From M{E) we are able to reconstruct the partition function, the free energy density and 
all the related thermodynamical quantities. 

As a second step we have looked for the ground state energy by using a minimization 
procedure. For a given N value we start from a random U{ configuration, and we minimize 

3 The sequence is specified by its first p = 57 elements. Therefore there are 2 P — 1 different sequences, 
which is exactly the number of possible translations. It can be shown that every subsequence of p elements 
appears once and only once, apart from the subsequence with all 1, which is forbidden. 



B(p) 



°~p+s ■ 
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its energy by single spin-flips. We repeat this procedure until satisfaction. We assume we 
have reached the ground state when the minimum energy has been found F times 4 . In the 
case where we also have the exact solution (N < 38) this procedure easily gives the correct 
ground state energy. The choice of F — 100 recognitions is still safe in the N region going 
up to N = 50. Low energy states with a small basin of attraction are the most dangerous. 
For the case of the good prime N = 47 (where by good we mean here of the form 4n + 3) 
the first excited state is found a number of times of order of 50 before finding the true 
ground state (which in this case, as we have explained, we know exactly). 

In fig. 1 we plot (N — 1) times the ground state energy as a function of N. The small 
filled triangles are from the minimization search. For N < 38 they are circled by larger 
empty dots (that reminds the reader that in this case we also have the exact result, which 
coincides with the the minimization result). 

At a first look the ground state energy (E ) depends quite randomly on N. But we 
notice some regular patterns which can be of some importance. 

• For N prime of the form 4n + 3 the ground state energy is the one given by the exact 
construction we have described before. This is a test of our programs and procedures. 

• For iV of the form 4n + 2, n zero and positive integer, i.e. for all the n we have 
analyzed, we find 



E N = 4 . (12) 

We cannot be sure that this behavior is not an accident, but we have to notice we 
find it for all values of iV of this kind. 

• For N of the form An + 1, n > 8, i.e. for N > 33, we have found that 



96 , . 

E N = 5-—. (13) 

For N of this form, even for N prime, our number theory based ground state con- 
struction does not necessarily give a ground state. 

We can use these results to try some claims about the N — > oo limit for the ground state 
energy. The merit factor, used for estimating how good a low autocorrelation sequence is, 
for a sequence of length N (and N large, or to agree with standard definitions we need to 
multiply times iV and divide times JV — 1) is given by 

F (N) = JL . (14) 

4 We are using in [14] the same procedure to try to find all solutions of the mean field equations for the 
Random Field Ising Model in 3d. 
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Figure 1: The ground state energy times (N — 1) as a function of N. The small filled 
triangle are from the minimization search. For iV < 38 where we also have the exact 
solution the small triangles are circled by larger empty dots. 
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If the energy goes to a constant value in the large N limit that means that the system will 
have a zero energy density, and a diverging merit factor. We know that on the primes N 
of the form An + 3 this is exactly what happens. But we also know that such N values 
have zero measure, and selecting such a sequence could not be a reliable way to go to the 
infinite volume limit for generic values of N. If the behavior we have described in equations 
(12), (13) survives in the large N limit we have two finite measure sequences (including one 
N value over 2) which have asymptotically a zero energy density. On the other iV values 
we are not able to draw even tentative and qualitative conclusions like the above. 

The number of configurations of a given energy J\f(E) allows us, as we have explained, 
to evaluate the thermodynamical properties of the system. In figures (2a-d) we show Af(E) , 
the number of configuration of energy £ as a function of E, respectively for N — 31 (a 
good prime), 33 (of the form 4n + 1, non prime), 34 (of the form 4n + 2) and 37 (of the form 
4n + 1, prime). In figures (3) and (4) we show respectively the internal energy minus the 
ground state energy (normalized between zero and one) and the specific heat as a function 
of T, for the same N values and a smaller volume, N — 19. 

At this point we are able to draw a few tentative conclusions. 

• Changing N of a small amount, typically of a AiV = 1 (when N is already of order 40), 
induces large variations in thermodynamic observable quantities in the low T region. 
Fluctuations from one volume size N to a similar one are large, and macroscopic. 
Such fluctuations forbid any simple extrapolation to the N — > oo infinite volume 
limit. They decrease however for increasing N. Their amplitude is compatible with 
being proportional to iV" 1 also at finite temperature. 

• A pronounced peak in the specific heat increases with N, strongly suggesting that 
in the infinite volume limit the system undergoes a phase transition. The T position 
of the maximum of the specific heat decreases with increasing N (in an irregular 
pattern). In the region of N ~ 30 — 40 from the position of the peak we estimate a 
critical temperature T c ~ 0.5. The nature and the order of the phase transition are 
difficult to assess. 

• The density of states M{E) for low energies depends on E approximately as 

Af(E) = 2Ne AE (15) 

(remember that the minimal degeneracy of the ground state is 2N). In our N region 
A turns out to be strongly dependent on N. Such a dependence can be fitted well 
by a linear behavior. This is the same effect we can see in the N dependence of the 
location of the peak in fig. (4). For our large N values (of order 30 — 40) the constant 
A is of the order of 1.5. 

• The configurations with energy slightly larger that the ground state energy are in 
average not similar to the ground state. The typical mutual overlap of a ground state 
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Figure 2: Af(E), the number of configuration of energy £ as a function of E. (a): iV = 31 
(a good prime); (b) iV = 33 (of the form 4n + 1, non prime); (c): N = 34 (of the form 
4n + 2); (d): N — 37 (of the form 4n + 1, prime) 
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Figure 3: The internal energy E(T) minus the ground state energy (and normalized between 
zero and one) as a function of T, respectively for iV = 19 and iV = 31 (good primes, 
respectively dots-dashes and dots), 33 (of the form An + 1, non prime, short dashes), 34 
(of the form An + 2, long dashes) and 37 (of the form An + 1, prime, continuous line) 
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and a first excited state is not large when N increases 5 . In particular typical first 
excited state configurations are not obtained by a single spin-flip operation on one 
of the ground states. The configurations which are generated by a single spin-flip 
on the ground state have in average energy higher than the first excited state. For 
example in the case of N prime of the form 4n + 3 the energy gap among the ground 
states and its one spin-flipped excitation is at least of 3. In this case no first excited 
state is a single spin-flip of the ground state. 

Let us analyze this point in better detail. For a ground state configuration Sq (the 
series of the iV spin variables a which form the ground state a) we define the overlap 
with the first excited state as 

0(0,1) = jyTj ""F^ " ' S ' ] ' (16) 

where A runs over all first excited state configurations, a can take values over all 
ground state configurations, and the • is the sum over sites of the product of the two 
spin variables. ^ is 1 when the ground state a corresponds to a first excited state 
which differs from the configuration a in a single spin flip. This is the maximum 
possible overlap. If there is the same number of equal spins and different spins 
0(0,1) = 0. For a given N value we define the maximum overlap of the ground state 
and the first excited state as 

O^maxO^ , (17) 

where the maximum is taken over all configurations which have the minimum energy. 
We plot 0(o\) as a function of N in fig. (5). The maximum overlap is 1 only for a 
few values of N (for large N, the ones of the form 4n + 2). For good primes it is 
always very low. 

A more useful information can be gathered if we look at the average ground state to 
first excited state overlap. We define 

<<W^Eo?o,i), (is) 

J v a 

where Mo is the sum runs over all ground states and Mo is their number. We plot 
(O(o,i)) in fig. (6). As N increases the average overlap decreases, and for N > 22 we 
never find a very large average overlap between ground and first excited states. 

At last we plot in fig. (7) the ground state energies, the first excited state energies and 
the average energy of configurations obtained by a single spin flip from the ground 
state (all of them multiplied times (N — 1)). The difference between single spin flip 

5 We define the overlap q of two configurations a and r as q = J2k cr kTk- 
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and first excited state is large, and in this case (even more than in fig. (6)) the effect 
does not depend dramatically from the cardinality of N. 

• Few configurations with very small energy start to dominate the partition function 
at low T < T c . We note that our estimate for the constant A coincides with our 
finite size estimate for the critical temperature (from the location of the specific heat 
peak). The relation T c ~ ^ (which holds in the REM model [15]) seems to apply 
here with reasonable precision. 

This scenario is very similar to the one we are used to see in spin glasses, when a 
replica symmetry broken phase exists. In particular it reminds of Derrida's Ran- 
dom Energy Model (REM) [15], where at low temperature only a very small set of 
configurations dominates the partition function [15, 16]. 

• As we can already see from fig. (4) the specific heat becomes very small in the low 
temperature region. Very likely it is exponentially small in the thermodynamical 
limit. We expect that the N^ 1 corrections (which in the REM [15] are proportional 
to (N(f3 — Pc))^ 1 ) dominate the specific heat in the low temperature phase for N not 
too large. 

• Derrida's model does not have the divergence of the specific heat at the transition 
point which we have here. This is likely to be the signature of a transition of a 
different nature than the one in Derrida's model. 

4 The Golay-Bernasconi Approximation and a First 
Replica Computation 

Let us try now to give an approximate analytic evaluation of the thermodynamical proper- 
ties of the model. We will follow the approach Golay [4] has originally introduced (see also 
Bernasconi work [5]) for the open model, and apply it to the periodic model. We will stress 
the interest and the obvious limitations of such a simple approximation (which basically 
amounts to consider the correlation functions Ct as independent variables). 

Let us consider the periodic model, and the correlation function Ct as defined from eq. 
(3). The basic observation is that on a generic random configuration of the a the correlation 
functions turn out to be also independent variables, randomly distributed according to a 
Gaussian distribution with variance N. Therefore for the probability distribution of the 
correlation function we can write 

P{C k ) = {2nN)~^ e-S , (19) 

which holds under our statistical independence hypothesis. Here k can vary from 1 to N. 
Let us take N odd. Since in this case the correlation functions satisfy the relation 
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Figure 7: (JV — 1) times the ground state energy (continuous curve), first excited state 
energy (dashes) and average energy of configurations obtained by a single spin flip from 
the ground state (dots) as a function of N. 
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Ck — Cn-u 

for all k values, the Hamiltonian (1) can be rewritten as 



(20) 



H^—^Cl. (21) 

iV 1 k=l 

In this case we only need to consider ^-=^ modes. For even N we should add to H the 
contribution at k — y without the factor 2. 

In this approximation the partition function is given by 

N-l 

Z{(3) = 2 N n { / dC k P{C k ) e-? H ^ } , (22) 
k=i J 

where we have used (20) and (21) to have k running only up to ^f^-. Substituting we get 

N-l 

Z(P) = 2-n{J-^=e-^^}. (23) 
For iV large we finally get 



Z(0) =6 N (M2)-iln(l+4/3)) (24) 

We have obtained the expression (24) under the assumption that the Oi are independent 
variables (and then also the C k are). This is obviously not true as soon as j3 > 0, and 
expression (24) fails. Indeed the C k are not Gaussian independent random variables. For 
(3 > when evaluating the partition function we sample the tail of the probability distri- 
bution P(C k ), where the expression (19) is not valid (we will see that the high T expansion 
does not coincide with the correct one even at first order). Here we are trying to under- 
stand (until now lacking a better approach: but see later) if at least in a high-temperature 
phase eq. (24) can be an useful approximation to the true behavior of our system. 

From the approximated result for the partition function of (24) we can compute the 
free energy density (7), and the usual thermodynamical energy density and entropy. We 
find 



fiP) = ^ln(l + 4/3)-ln(2)); 



ei^ - TT^ ; (^) 
s((3) = ln(2)--m(l + 4/3) + 



1 + 4/5 
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The behavior of the energy density is quite reasonable, while the entropy density s(/3) 
becomes negative at low temperature (it goes to — oo at T = 0). The entropy density s({3) 
becomes zero at (3 G = 10.3702, where the energy density has the value e G = e((3 G ) = .02354. 

A possible approximated approach to the problem (along the direction hinted by Golay 
and Bernasconi) would be based on saying that this solution is close to the correct one in 
the high T phase, for j3 < f3 G . One would then claim that a good approximation is to state 
that for f3 > fie general thermodynamical properties (i.e. the fact that both the specific 
heat and the entropy are not allowed to become negative) imply that the energy density 
has to remain constant 



We have a scenario which is very reminiscent of the REM [15]. As we have already 
noticed an obvious drawback of this point of view, which is built on a series of arbitrary 
assumptions, is that it does not reproduce correctly even the first non-trivial order of the 
high T series expansion. It captures however some of the relevant features of the model 
(like for example the presence of an abrupt transition at finite T), and it seems worthwhile 
to try to understand better its features. 

Now we will try to apply the replica method to the problem of sequences with low 
autocorrelation (at a first stage to try to recover the results of the Golay- Bernasconi- 
Derrida (GBD) approximation we have just discussed). We know that replica methods 
have been applied with good success [1, 2] to the analysis of systems whose behavior has 
remarkable similarities to the one of our low autocorrelation sequences. Yet, until now 
replica approach has been dealing with system in which quenched randomness plays a 
major role. There is nothing of a priori random in our low autocorrelation sequences, and 
the replica method could seem here out of place. 

However if it is true that the generic properties of the behavior of low autocorrelation 
sequences have something to do (at least for not too low T) with the ones of a system with 
quenched disorder. Then we can hope to use the replica techniques 6 . 

We will want a random system which mimics the properties of our original ordered 
system. We will have to identify such a system on the basis of some general principle, and 
we will see that this will be more or less easy in the different cases. 

One possible approach is based on considering a Hamiltonian 



which depends on the quenched control parameters {J}, which are randomly distributed. 
For a particular realization of the sequence {J} such random Hamiltonian coincides with 
our original Hamiltonian (in the present case with (21)). Let us suppose that we are 
able to use the replica approach to compute the average of the thermodynamic functions 
for the system described by (27). Now we can hope that the result obtained for a generic 

6 The following conclusions and the replica computation presented in the next paragraphs have been 
obtained independently for the open model by Jean Philippe Bouchaud and Marc Mezard [12]. 



e{/3)=e G , V[3>P G . 



(26) 



H { j } ({*}) , 



(27) 
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realization of the random variables {J} is the same we would have obtained by selecting the 
exact {J} sequence which leads to the original Hamiltonian (21)). In this case the replica 
symmetry gives the correct result for the deterministic model. This way of reasoning is 
potentially very dangerous, and can lead to disaster. The 3c? Edwards-Anderson model, 
once understood (for recent progresses see [17]), will not very probably lead to the same 
solution of the ferromagnetic 3c? Ising Model. The issue here deals with how generic is the 
special {J} sequence which gives the original deterministic Hamiltonian, and cannot be 
solved a priori. A posteriori for example one can verify if the deterministic and the random 
models have the same high-temperature expansion (of course this may lead to surprises in 
the low temperature region). 

A second possible approach is based on the introduction of a control parameter e, and 
of a Hamiltonian 

tf e ,{J>(W) > ( 28 ) 
which interpolates from the random Hamiltonian at e = to the deterministic Hamiltonian 
at e = 1. If the interpolation is smooth and there are no phase transitions in the interval 
< e < 1 the perturbative expansion around the result e = (which one should be able 
to obtain) could be used to estimate the results for e = 1. 

This is the general framework. We hope that, by using one of these approaches, replica 
method will enable us to obtain qualitative and quantitative predictions about the deter- 
ministic problem. 

Let us start by trying to reproduce the GBD result (i.e. the simple approximation we 
have just studied) in the framework of replica theory. Our aim will be to consider a soluble 
random model such that the probability distribution of correlation functions is Gaussian, 
as in (19). In the high-temperature phase the free energy density of such a model should 
be given by the GBD approximation. 

We will consider the Hamiltonian 

JV — 1 

H ^P 1 ' (29) 

In this new model the are not simply correlation functions anymore, but they are given 
by 

C k = J2 J ra,j a mO-j , (30) 

m,j 

where the J are quenched random variables with an average value of order and variance 
jj. The precise form of the distribution is irrelevant. A possible choice for the distribution 
of the J variables is 

jfj = with probability 1 — — , 
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Jf , = 1 with probability -J- . (31) 



1 



N 



Random J variables allow connections of random site couples i — j. Since the <jj 
are connected randomly it is reasonable to expect that in the large N limit the modified 
correlation functions C k are indeed distributed as independent Gaussian variable. So we 
expect our random model defined by (29), (30) to have the same behavior (at least in the 
high-temperature phase) than the deterministic model defined by (19), (21). 

The model can be studied by means of the usual replica techniques. The partition 
function 

JV-l 

M JV 1 k=i 

is quartic in the spin variables a. We can introduce the variables X k to disentangle the 
interaction, getting 



JV 

2 ' dX k r Xl , i 



zum = e n / 7& ex p{-§ + -^^e^-^)} 

{a }k=l J V«7TP »P ViV mj - 



(33) 



(where for large iV we have written TV instead of N — 1). 

We want to compute averages over the {J} of the free energy density of the system, 



f W = ^J-pN HZ{J}(m ' (34) 
where the average is a quenched average over the disorder. We can employ now the replica 
trick, rewriting the average over the disorder of the In Z as 



f{(3) = lim (--!- lim Z{J}(/3) " * ) . (35) 
By adopting the usual abuse of inverting the two limits we finally get 



/(/?) ee lim/")(/3) , (36) 



where 



*<->GS) = lim ( --L Z <"W-' ) . (37) 

Computing the average over the disorder of Z n is easy. By assuming a Gaussian distri- 
bution for the J variables 7 (with zero expectation value and width -^) we find that 

7 The result of the computation depends only on the variance of J. Imposing a priori (J) = does not 
change the result. 
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JV 

2 r n rlVo- 1 n I 

^)-=En / n(7=)-p{-^Era 2 -^E(E^>j) 2 } . (38) 

{ ff }fc=l' / o=l V^P »P„ = l 2 m,ja=l 

The second term in the exponential couples the different replicas. We can rewrite it as 

^E*fc(E^O(E (39) 

a,b rn j 

In order to decouple this interaction we write 1 as 

i = n / d Q*t S (Z *M - wq«j) » ( 4 o) 

a,b j=l 

and use the Lagrange multipliers A a ^ to rewrite the 5 functions 

TV 

1 = II [ / dKb exp{2A a , b (E " WQ a , b )}] • (41) 

a,b j=l 

Now using eq. (41) in (38) we can integrate over the X% variables, and disintegrate the 
sum over the Oj configurations. We get 



Z {J m n = J U(dQa, b ) Il(dK b )e~ NAiA ' Q) , (42) 

a, b a,b 

where 

A(A, Q) = G(Q) + F(K) + T(A, Q) , (43) 



and we have defined 



G(Q) = ^Trln(<5 a , 6 + 4/3Q^) 

F(A) = -ln(Eexp{EAa^V 6 }) (44) 
T(A,Q) = Tr{A a , ft Q 6 , a } , 

where the trace Tr is taken over the replica indices, and the integral over K a b is taken over 
the imaginary axis. 

In the large N limit Z{j}(j3) n is dominated by its saddle point value, i.e. we get that 

= ^ , (45) 
where by A SP we have indicated the saddle point value of the expression (43). 
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In the high temperature phase we can look at the replica symmetric solution, where 
Qa,b = for a 7^ b. The saddle point equations for A imply that Q a ^ a = 1 (this result is 
valid at all temperatures). The expression for the free energy reduces in this way to eq. 
(25). The result is, as we promised before, the same of the GBD approximation. 

Before studying the properties of the broken replica solution of this stationary equation, 
we can get some further insight into the model by considering the following generalization: 

2 aN/2 ~ 

where the quantities are defined as in (30). Here we have only changed the number 
of J values which can couple two sites i and j. Since here we are not dealing with pure 
correlation functions, but with terms which are coupled or not according to the value of a 
random variable, there are no reasons for fixing the total number of non-zero J values to 
be of order of N 2 . For a = 1 we recover our previous model. 

The model can be solved for generic a and one finds results that are very similar to the 
previous case. The only difference is that now 

G(Q) = J&Ml + ^go. (47) 



In the limit in which a goes to infinity all sites are coupled and the model describes an 
infinite range 4-spin interaction. In this limit one gets 

a,b 

which is the known result for the p = 4 model [16]. For a going to zero frustration 
disappears. In other words the models based on H a are related to the generic 4-spin 
random models in the same way as the Hopfield models are related to the Sherrington- 
Kirkpatrick model. 

In the limit p — > oo the model with a p-spin interaction coincides with the REM [15]. 
In the low temperature phase replica symmetry is broken at one step [15, 16]. In this case 
(where p — > oo) the entropy at the transition and below the transition point is zero, and 
the self-overlap parameter q(l) jumps from to 1 at the transition point [16]. Let us also 
note that in some sense [16] the p = 2 Sherrington-Kirkpatrick case is a special case, and 
that as soon as p > 2 things change. For example as soon as p > 2 the phase transition 
becomes, as far as the function q(x) is concerned, first order. 

We have computed the one step replica broken solution for our a-dependent model. In 
this case the matrices Q and A are described by the breakpoint m and by their value inside 
a block. In the limit n — > we find that 

= <i^ Hl+ v * ^ ^ fm + 1 _ q2 

Am Ja Am Ja 
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F(A) = A -—In 



+°° dx 



e~ x ~ cosh m (v / 2Aa;) - In (2) 



(49) 



m 




T(A,g) = Ag(m-l) . 



We can solve now the saddle point equations for A$p under the form (49) for the p = 4 
spin interaction (our model for a = oo). This gives the free energy density of the one 
step replica broken solution (that is exact for the p — > oo model). Here we find that the 
entropy at the transition is very small (about .01) and that the self-overlap parameter g(l) 
is very close to 1 (it is greater than .95). The GBD approximation describes a scenario 
with a zero entropy at the transition point, and q(l) jumping from to 1. That means that 
the difference between the GBD approximation and the infinite range 4 spin interaction 
is of the order of a few percent (on the expectation values of typical thermodynamical 
observables) . 

The situation improves if we look at to our model with a — 1. In this case, assuming one 
step replica symmetry breaking, we find that the entropy at the transition is tiny (smaller 
than .0001) and that the self-overlap parameter q(l) is very close to 1 (it is greater than .99). 
The inverse transition temperature is practically identical to the one we have found in the 
GBD approximation (after eqs. (25)). Here the Golay-Bernasconi-Derrida approximation 
is practically perfect. 

That completes a quite detailed understanding of our a-dependent disordered model. 
We have obtained the one step replica broken solution of the model, and it has been useful 
to show that the model undergoes a finite T phase transition to a glassy region, where the 
partition function is dominated by a restricted set of states. The corrections to the GBD 
approximation can be computed and they turn out to be very small. 



5 The High- Temperature Expansion of the Low Au- 
tocorrelation Model and a Hartree-Fock Resumma- 



In the previous section we have used replica theory to analyze and solve a model which 
does not have the same high-temperature expansion than the low autocorrelation model 
we started from, i.e. the one defined from (1,3). Altogether we have been acting quite 
recklessly. We have introduced a (maybe not so good) approximation to our original 
deterministic model, and we have defined (in (46,30)) and solved a model with quenched 
random disorder which reproduces such an approximation. This has been useful to show 
that replica theory can play an important role even in the understanding of statistical 
models which do not contain quenched disorder in their formulation. Still, now we are 
interested in stepping forward, and getting a deeper understanding of our original model. 

The first tool we will use to learn more about the full low autocorrelation sequence 
model is the high-temperature expansion. As matter of principle this can be done in a 
very straightforward way, but on practical grounds the fact that model is non-local creates 



tion 
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lot of complications. For example the coefficient of the high T expansion (of the energy 
density, let us say) are not polynomial in N, as they would be for a well behaved interaction. 
Only the leading contribution (in iV _1 ) at each order in (3 is universal, while subleading 
corrections tend to depend on the cardinality of iV (for example we can have a given 
polynomial for odd N and a different one for even N, and so on with more and more 
complicate behaviors). 

The direct evaluation of the high-temperature approximation in x-space is possible, but 
not very convenient, because of the problems we have just described. We have just used it 
to check the general behavior of particular classes of diagrams. We have found convenient 
to use instead the momentum space representation Hamiltonian (4). We have computed 
the leading terms in N~ l of the first 3 non-trivial f3~ k expansion coefficients for the free 
energy density, i.e we have only considered connected diagrams in the expansion of the 
partition function Z{(3). 

For example the coefficient of the (3 2 term (for the free energy density) is 

J^l^tE \B(h)\*\B(k 2 )\ 4 \B(k 3 )\% , (50) 

where the small c signifies that we have only included in the sum contributions from 
connected diagrams. In order to compute the diagrams 8 one has to analyze separately the 
case where k-y = k 2 = k 3 , the case where two ki are equal and the one where all the three 
fc's are different. By using this approach we have been able to find that the first 3 orders 
of the small f3 expansion of the energy density (deduced from the free energy density by 
the usual relation e(/3) = —d(/3f(/3))/d/3) are given by 

e((3) = 1 -8f3+ 1Q0{3 2 + 0({3 3 ) . (51) 

We have also looked at subleading contributions to the energy density [3 2 term, both 
in real space and in momentum space. One easily sees that there are in this case diagrams 
which are proportional to 

nEMSki), (52) 
fci 

where <5at(A;) = 1 -<=>- k = 0(mod N). A term of this kind gives a non-zero contribution 
only if N is multiple of 3. 

The number of relevant diagrams proliferates at the next order in (3 {0((3 3 for the 
internal energy). Here subleading corrections also contain terms proportional to 

4EM5*i). (53) 

k\ 

which now also distinguish the N values which are multiple of 5. 

8 One has to be be careful in noticing that |-B(p)| = \B{— p)\ in order to avoid double counting. 
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At last we have been able to check that at order f3 A (again for the internal energy) there 
are terms of order N~ 5 which even for iV odd have a different expression depending on if 
N = l(mod4) or not. 

Indeed the easiest way to compute the high-temperature expansion coefficients turned 
out to be based on the exact solution of the systems with size up to N = 38 we have 
described before (together with the insight about the diagram structure we have described 
in the former paragraphs). We have used here the density of states Af^(E). The cumulant 
of order k 

(H k )f\(3 = 0) (54) 

can be used indeed to fit the N~ j coefficients of the (3 k term in the high-temperature 
expansion. In better educated models such coefficients would be simple polynomial in N, 
and the information we have would (for N up to 38) would allow us to fit a large number of 
terms. Here on the contrary we have a polynomial behavior only on selected subsequences 
of iV values (that we have discussed before). So the number of terms we have been able to 
work out is quite low. 

Already the term of order 1 in the energy density is different for odd and even N values. 
We find that 

e£\(3,N) = 

<%\(3,N) = 1, (55) 

where by the subscript to e we indicate the order in /3, and by the upperscripts (e) and 
(o) we indicate respectively even and odd. The same structure survives at next order in (3, 
giving 



e[ e \(3,N) = (3(-8 + ^ 2 ). (56) 

We have been able to check directly from the diagrammatic expansion the full expressions 
(55) and (56) (including all subleading correction). 

We have already explained that at order f3 2 we get different results depending on if N 
is multiple of 3 or not. For iV of the form 3n + 1 and 3n + 2 (integer n) we find 

= + (57, 

while for iV multiple of 3 we get 

(31/ „ n i, 1008 1856 752 x 

4 3) (A N) = ^(160 -_ + _-_), (58) 
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where here by the superscripts (3) and (3) we have designated N values which are and are 
not multiple of 3. 

At next order in (3 (/3 3 for the internal energy density) we have been able to find the 
exact polynomial only for N non multiple of 3 and 5 (that for our iV values, and indeed up 
to iV = 77, coincide with prime values). Here we had 9 numbers (the momenta for primes 
going from 7 to 37) and 5 coefficients to find. That is redundant enough to allow to check 
carefully that we did the right thing. For the other N value subsequences at this order, 
and next orders in f3, we have not been able to calculate the expansion coefficients. Here 
we find (with obvious notation) 

As far as the leading N~ k term is concerned we have in this way gained one order in 
our small (3 expansion, by finding 

e((3) = 1 - 8/5 + 160/5 2 - 5248/5 3 + 0([3 4 ). (60) 

Can we learn something more about the model in its high-temperature phase? We hope 
so, and in order to do that we will now try to write down a statistical model that hopefully 
resums the high-temperature expansion. 

But for a trivial shift in the energy we can rewrite the partition function of the low 
autocorrelation model as 

r N 2B 2 

Z{0)= /riK] ex P{-TFEl^| 4 }, (61) 

J i=l iV p=l 

where the B p are the Fourier transformed variables defined in (5). Let us define now the 
new Hamiltonian 

AT 

H V (B) = ^±\B P \^, (62) 
iV p=i 

where now the B p are the fundamental variables of the model. In the case v — 2 this 
Hamiltonian coincides (apart from the trivial energy shift) with the one of the original 
model. The case v — 1 will be of large importance, since in this case Hi — N for all {a} 
configurations. 

We can obtain a very simple result if we select only the contributions to the high T 
expansion which come from diagrams in which all momenta are set to be equal. That 
means for example we choose from (50) only contributions with k\ — k% — k%. 

It is easy to resum these diagrams. In this case we find that the probability distribution 
for the B p factorizes in an independent contribution for each momentum, and we get that 
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(f(B)) = J dBdB f(B)P(B) , 
P(B) oc exp(-\B\ 2 - 0\B\ V ) . (63) 

This result cannot be the correct, complete answer, since it implies that \B\ 2 is a function 
of /3, while we know that for all (5 values the correct answer is 

{\B\ 2 ) = W 2 ) = 1 • (64) 

However we will see with pleasure that we are not very far from the correct answer. 

It is clear that leading contributions coming from diagrams where the flowing momenta 
are different exist, and we will have to consider them. These contributions generate an 
interaction in our effective Hamiltonian, and they cannot be neglected. A detailed inspec- 
tion of the large N leading contributions in the high temperature expansion leads us to 
conjecture that for large N the partition function of the low autocorrelation model can be 
written (at least in the high T phase) as 



r 2 2 AT 2 

Z v (/3) = / \{[dB p dB p ]^ V {-^\B p \ 2 }^ V {-g{V)}^ V {-P^H v {B)} , (65) 
J P =i P =i A P =i 

where the operator V is defined as 

2 2 <9 2 

V=-Y — , (66) 
N £t[ dB p dBp 1 ; 

the integral is taken over real and imaginary part of B p , and g is a function which does not 
depend on v and which we will explicitly compute. 

We have here a guess for the form of P(B). We have a Gaussian weight over the S's, 
a weight given by the Hamiltonian and an interaction correction term, the function g. 
Such a conjecture comes from a comparison with the dominant contributions in the high- 
temperature expansion of the original formulation of the model. For all terms we have 
been able to think about the correspondence holds 9 . As we shall see later the expression 
we have conjectured essentially corresponds to a Hartree-Fock approximation. 

Let us start by evaluating the partition function (65) for a generic function g. 

As usual it is convenient to introduce the representation 

1 = J ' dx 8{x-V) = j dx j d\ exp{i\(x - V)} . (67) 

By inserting the 5 function the dBdB integrals factorize, and we get 
9 The doubtful reader will find a different derivation of this result in section (6). 
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Z„(P) = J dxj d\ e^ iXx+9 ^[dBdBe-\ B \ 2 e~ x dMe-^ 21 '}^ , (68) 

where the derivative operator only acts on the last exponential function. 

In order to compute Z v (f3) we can use now the familiar expression for the heat kernel. 
Let us consider the real variable z, and the operator O acting on functions /. The kernel 
of O, K Q , is defined as 

(Of)(z) = jdz> K (z,z')f(z') . (69) 

If we consider now the operator exp{ — Aj^-} we find that its kernel (the heat kernel) 
has the form 

1 e"^. (70) 



2V7rA 

We can use this last formula to rewrite Z u (f3) (the most transparent approach consists in 
using as independent variables real and imaginary part of B, getting in this way two real 
heat kernels). Now the integrals over the left variable of the two kernels are Gaussian. 
After integrating them out we are left with the expression 

Z v {(5) = J dxj dX e T[£+*(*)+mM+£(/W] , (n) 

where we have defined // = (1 + 4A)" 1 , g(x) = g(x) — |, and 

L((3,fi) = ln{ J dBdBe-^ 2 -^} . (72) 

The former expression can be evaluated in the large iV limit by taking its saddle point. 
One finds that 



s'W + i = o, 

~ + I ~ - , (73) 

where the expectation value is computed with the effective local Hamiltonian: 

H(B) = fi\B\ 2 + P\B\ 2u . (74) 

We have also to impose that the sum of the \B\ 2 is one, which was a crucial feature of 
our original model. If the expectation value of \B\ 2 is one than the expectation value over 
the effective Hamiltonian also has to be one. That gives us a third equation 



(\B\ 2 ) eff = 1 • (75) 
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We have found that the saddle point free energy is determined from 



+ ^ = o, 



X 1 



1 , (76) 



4/i 2 \x 

(\B\ 2 )eff = I- 

The second of equations (76) gives us x as a function of fj,, i.e. 

x = A(fi- fu 2 ) . (77) 
Now we can use the first of equations (76) to determine the function g. We find that 

~g\x) = , (78) 

2(l + (l-x)3) 

that gives 

g(x) = -ln(l + VT^) + v / T 3 x (79) 

(where we have omitted an irrelevant constant). 

Now it easy to compute the saddle point free energy density. One only has to use 
the third of equations (76) to determine the saddle point value of fi. The expression for 
ln(Z u (/3)) eventually greatly simplifies. 

If we are only interested in computing the expectation value of the energy density we 
can use a shortcut, by noticing that the energy density of the model is the derivative with 
respect to j3 of the logarithm of the partition function, and can be expressed as 

e(P) = dBHeff ■ (80) 

The former identity has to be supplemented by the condition (75), i.e. jj, is fixed by setting 
the expectation value of \B\ 2 over the effective Hamiltonian to one. In a language suitable 
to field theory addicts we can say that only tadpole diagrams have survived. The total 
contribution of the tadpoles is fixed by the condition eq. (75). Given the simplicity of the 
result it is quite likely that our proof may be simplified. 

We have tested the correctness of our conjecture by computing the corresponding high- 
temperature expansion and by verifying that the first 4 coefficients are indeed correct, and 
coincide with (60). Our Hartree-Fock resummation is equivalent, as far as we can see, to 
the complete low autocorrelation model at least in the whole high T phase. 
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6 The Replica Approach 



In the previous section we have succeeded to write a closed form for the solution of our 
model in the high T phase. We are ready now to try to achieve the main result of this 
paper, and show that replica theory can be used to obtain the solution of a non-random 
spin model. We will define a disordered model which has the correct high-temperature 
expansion of the initial non-random model (and contrary to the GBD case we will not 
need here any approximation), and that can be solved at all temperatures by using the 
replica method. 

The model we propose is based on the simple observation that the Fourier transform 
is a very special unitary operator. Naively one could think to write a model where the 
Hamiltonian is the one defined in (62) with v — 2, but the basic configurational variables 
which will be integrated over are 



where the U matrix are generic unitary transformations, and compute the thermodynamic 
properties of the model for a random choice of the U matrices. The point is here that the 
Fourier transform is one particular unitary transformation, and we try to understand what 
happens if we substitute it with a random transformation. 

One has to be slightly more sophisticated than that, since by using generic unitary 
matrices U already at the first orders of the high T expansion one gets a result that is 
different from the one one obtains when using the Fourier transform. This effect can be 
traced to the fact that by using a generic unitary transformation we are ignoring the fact 
that in the original model we were transforming real functions, and there 



This reality property turns out to be crucial, and our model with quenched disorder will 
have to account for it. In order to satisfy this constraint we will consider the Fourier 
transform as an orthogonal transformation which carries a real function in a complex one, 
which satisfies (82). We introduce the variables A(p) by 



(81) 



3 




(82) 



B(0) 



A(N) , 




(p) 



A(2p) + iA(2p + 1) for p = 1, 



N — 1 



(83) 



2 



and (for even N) rewrite the Hamiltonian (62) as 



JV-l 
2 



H = £ \A{2p)+iA{2p+l)\±+\A{l)\*+\A{N)\* 



(84) 



P =i 
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Our random model will be defined, in the large N limit, from the equivalent Hamiltonian 
(we are forgetting contributions of relative order of magnitude N^ 1 ) 



N_ 

2 



H = "£\A(2p-l)+iA(2p)\ A , (85) 
P =i 

where the A variables are defined from the spin variables Sj as 

N 

A(p) = J20 p , j a j , (86) 

3=1 

and the O p j are random orthogonal transformations, over which we will integrate. 

The model we have obtained can be studied using the replica approach. In order to 
present the replica computation for models of this kind in a compact way we will describe 
the solution of a model based on unitary matrices. An explicit computation shows that if 
we solve the orthogonal model (86) along the same lines we obtain (apart from a rescaling 
of (3) the same thermodynamical behavior in the large N limit. We define the Hamiltonian 

JV 

H = ±\C(p)r, (87) 
P =i 

where 



C(p) = E^^ > (88) 
i=i 

the C/'s are random unitary transformations and tj = a^j-i + i<Jij- We have effectively 
written a model which is based on y x y unitary matrices (naively we would have used 
N x N unitary matrices), ensuring in this way to get the correct normalization of the 
free energy in the high T expansion. The aim of this section will be to solve this model 
(which will eventually be of interest for us for v — 2) and to show that its high-temperature 
expansion is the same than for the original low autocorrelation sequence model. 
We proceed as in section (4) and introduce replicas. We find that 



Z n oc / dUdXdCdXdC 



AT AT 
2 2 



E M exp{]TE \C a {pT + m a (p)C a ( P ) - Xa(p) E UnTf) + h.c)]} , (89) 

a p=l j=l 

where with dX and dC we indicate respectively Y[a, p X a {p) and Y[ a ,pC a (p), with (a = l,n), 
(p = 1, y). The integrals are taken over the real and imaginary parts of the variables A 
and C, and the integral over dU is over the unitary group. We have to compute an integral 
of the form 
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/ 



dUexp{ ttpjUpj + h.c.} , (90) 

with Q p j = J2 a ^a{p) T j , Tr(QU) ~ N, and the integral is performed over the unitary 
group. This problem has been solved in full generality by Brezin and Gross [18]. However 
their formula is more complicated of what we need here. At finite non-zero n, in the limit 
of iV going to infinity, only the terms containing one single trace operation survive, and 
the integral is given by 



/ 



N QQ* 

dU exp{Tr(W + h.c.)} = exp{ y TrG(^)} , (91) 

where G(z) is a function which form we want to derive. Let us consider the case in which 
the matrix f2 has one single element different from zero, for example Qn = We define 
the function G(z) from the relation 

r NzII \z\ 2 

1=1 dUexp{—^± + h.c.} = exp{iVG'(^)} . (92) 

The integral over the unitary group is given by 



r N 

I = j dU exp(—zll hl + h.c.) 



,N 

N y 

dx 5(^2 x j ~ !) exp{—z Xl } (93) 
i=i ' 2 



-I 

/2\ — r N 

dxi(l — x x ) 2 expj— zx\} . 

We have used here the fact that a randomly chosen line of the unitary matrix is only 
constrained to have the sum of its elements equal to one. The last integral can be evaluated 
by using the saddle point method. We find 



r iv 
J dx 1 exp(—f(x 1 ,z)) 

r N 

J dx! exp(y (log(l - x\) + z Xl )) . (94) 



The stationary point x of this saddle point equation gives I ~ exp(y/(Z)). Using eq.(92) 
we find 

g{z) = - in( v / r+i + 1) + v / rn . (95) 

This result can also be derived using the Brezin and Gross formulae [18]. G corresponds 
to the function g of the previous section. 
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Now we have to compute TrG(^-). It is easy to verify that for all positive integer 
values of P 

Tr{(^) P } = Tr{(AQf} , (96) 
where A and Q are n x n matrices, defined as 

JV 

1 2 



K b = -77 J2 Kp) a Kp) b , 
JV p=l 



JV 

Qa, b = ^E«. (97) 

JV k=l 



That implies 



TrG(— ) = TyG(AQ) . (98) 

The computation now continues using the standard techniques introduced in the sec- 
tion 4. First we introduce auxiliary fields R and M associated to the matrices Q and A 
respectively: 

l=T[JdQ ab 5(Q ab -±Y<^~h 

ah i 

= Uj dQ ab dR ab exp{tR ab (Q ab - l^ r «^)} , (99) 

ah i 

(100) 

and analogously for A a 5 and the Lagrange multipliers M ab 

1 = II / dA ab S(A ab - -j= £ A(p) a 

~ II / ^A a 6rfM a5 exp{*M afe (A a;) - -^ £ A(p) a A(^)} . (101) 

(102) 



Putting all together we find that we need to compute 



Z n E T / d\d\dCdC J dkdMdQdR 



exp{ iM(A-l£A p A p }exp{iR(Q-^£r^} (103) 

P i 

exp{ iVG'(Ag)}exp{|C| 2ly }exp{iAC + /i.c.} . 
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Performing the integration over the A variables we finally obtain that (iVln(Z)) 1 is given 
by the stationary point of 

= / dQdRdKdM exp{NA[R, Q, A, M}} , (104) 
(where we have defined M = (4M) _1 ) which means 



Pf = -^A SP [R,Q,A,M\ . (105) 



The function A is given by 

A[R,Q,A,M] = 



F f {M) +Trln(M) - Tr^ + TrG(AQ) - TrRQ + F S (R) , (106) 



where 



exp{F f (M)} = f dCdC exp{-/?^|C a | 2 ^ - ^ C a M a , b C b } , 

J a a ,b 

exp{F s (R)} = J ' d{r}exp{J2Ra,br a n} ■ (107) 

a,b 

The previous formula is also valid in the case of a continuous distribution of the spins a. 
In the present case the spin take the discrete values ±1, and we have to substitute the 
integral by a sum. 

In order to solve the saddle point equations we start by eliminating some of the auxiliary 
variables. The full set of saddle point equations for A gives: 



9R a b " 9R a b 

8 A 1 

: ) ab + (QG'(AQ)) ab = , (108) 



dA ab AM' 
8 A 

-R ab +(AG'(AQ)) ab = , (109) 



8M ab 8M ab y M /au LV 2 
After some algebra and using the relation 



9Qab 



8A _ dFf(M) ( 1 N ( A 
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we can phrase our result in a very simple form. The free energy is given by the stationary 
point of 

A[M,R] = F f (M) + F S (R) +Trln(4(M - R)) . (112) 

The expectation values of quantities which are local in momentum or in configuration space 
can be computed using respectively the simple Hamiltonians 



7~Lm = -P^2\Ca\ 2l/ -^2C a M a)b C b , 

a a,b 

Kit = J2 R ^b T aTb- (113) 

a,b 

The saddle point equations for the stationary free energy are now 



{CaPblM — ( T a T b)R — Qa,b 

{M-R)Q = 1, (114) 

where the mean values (...)m an d (•••)# are evaluated using the Hamiltonians Tic and Tin 
respectively. The first condition is a clear consequence of the unitarity of the transforma- 
tion. The second equation has a less clear meaning 10 . 

In the high temperature phase the different matrices are non-zero only in their diagonal 
part. This can be computed in the annealed case n — 1. In this case the different matrices 
have a unique element Q — 1, A — X, R — r and M. The free energy is given by: 

/3f = -]nJ dCdC exp{-(3\C\ 2v - M\C\ 2 } - log(2) , (115) 
where M is determined by the simple equation 

(|C|% = 1. (116) 
The internal energy is given by the relation 

m = ^§f- = (\cnM, air) 

which coincides with the corresponding equations of the previous section a part from a 
rescaling of (3. 

We have shown that our model reproduces the high-temperature expansion of the effec- 
tive action conjectured in the previous section. For a random system it is well known that 
the annealed free energy is a lower bound to the quenched free energy. That enables us 



10 We feel a bit guilty of presenting such a complicated proof for such a simple results, but this is the 
best we have been able to do. 
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to develop at least a partial analysis of our results without doing the explicit computation 
of the replica symmetry breaking in the limit n — > 0. Let us notice, indeed, that in this 
light the results of the previous section imply that the ground state energy of the model is 
greater than 0.025. 

Explicit formulae can be written in the case of one step replica symmetry breaking. We 
want all the three matrices R,Q,M to commute. To this end we break each one of these 
matrices into sub-blocks of equal size m. The different elements are, for instance in case 
of the matrix M, M aa = M D and M ab = M x if the indices (a, b) do belong to the same 
sub-block of size to, while otherwise M ab = 0. The same holds for the matrix R. The 
variational parameters are now to, Mp, Mi, Rd, Ri and qi(Q aa = 2), and the saddle point 
equations are: 



/ dn(z)(\Cf) z 

dp(z)\(C) z \ 2 = J dp(h)\(r) h \ 2 

(M D - R D ) + (to - l)gi(Mi - R x ) 
(Mi - Ri)(l + (to - 2)qi) + (M D - R D ) Ql 



Qi , 

1 , 
0, 



;ii8) 



where 



d/i(z) oc exp( 



2Mi 



)Z(z) m dzdz, 



(f(C)) z = J dCdC exp(-[3\C\ 2 " - (M D - M!)|C| 2 - 2U(zC))f(C) , 



dp(h) oc exp( 
(t)h 



)cosh rn (h R ) cos\i rn (h T )dh dh , 



2Ri 

tanh(/if{) + i tanh(/i/) 



(119) 



We have not studied in detail the solutions of these equations, but from the previous 
experience we conjecture that there is a transition very similar to the Derrida model, and 
that such a transition corresponds to a first step of replica symmetry breaking. We expect 
the free energy lower bound we have obtained from the annealed approximation to be very 
good. 



7 A Discussion of the Phase Diagram 

If our initial conjecture about our effective theory and Hartree-Fock resummation is correct 
we have solved the model in the high T phase (with two different approaches). That does 
not mean we have acquired a large deal of information in the low T phase. Indeed the 
formulae we have found cannot be valid at all temperatures since (analogously to what 
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Figure 8: The analytic result for the energy as a function of T. 

happens in the GBD approximation) it leads to negative entropies at low temperatures, 
and the entropy diverges logaritmically at zero temperature. 

We plot in fig. (8) our result for the energy as a function of T. In our solution the 
energy goes to zero only at T = 0. In an approximation of the GBD type the entropy 
becomes zero at a non-zero Tq, about .1, and the T = energy does not change in the 
cold phase, and remains fixed to its value at Tq and different from zero (i.e. about .025). 
It is clear that we have to expect that the high-temperature approximation breaks down 
before T is lowered to the point where the entropy is zero. More precisely it should break 
in the region where the free energy is still negative, since the exact result is that the free 
energy is zero at T = (at least for prime values of iV and quite likely for all N). 

The comparison of these analytic results with the exact computations is very interesting, 
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and we show it in fig. (9). In the whole high temperature region where the energy varies 
from 1.0 to 0.2 the agreement is very good, strongly supporting the correctness of our 
solution in this temperature range. There is a disagreement in the region where the energy 
becomes smaller and T — > 0. 

The temperature where the free energy becomes zero is about Tp = .30 (where the 
internal energy is about .074). 

At such low T values the probability of finding the system in an excited state, typically 
a single spin-flip of the ground state, is negligible, since we know that the energy gap is at 
least of order 3. Let us draw a few possible, plausible scenarios: 

• The high-temperature approximation is valid down to a temperature very close to Tp. 
At this temperature there is a first order phase transition to a state with practically 
zero energy density. In this case the discontinuity in the energy will be close to .074, 
and the discontinuity in entropy close to .25. This is the possibility that is favored 
from our evidence. 

• The high-temperature approximation breaks down at a temperature higher that Tp, 
i.e. about T = .5. In this case the transition could very well be of the second 
order from the thermodynamic point of view. We do not have any evidence for this 
possibility, but we cannot exclude it. 

• It is also possible that when N — > oo for some values of N the energy density remains 
different from zero. If that is what is happening the analytic results obtained by using 
replica theory could be exact at all T values, even in the low T region for these values 
of N. In other words we suggest the possibility that two different thermodynamic 
limit can be obtained if we send iV — > oo along different sequences. This would be a 
rather strange phenomenon (which can happen only due to the infinite range nature 
of the forces), however the non-unicity of the thermodynamic limit is present in a 
related spin glass model [11]. 

From our results we are not able to discriminate in a definitive way between these 
possibilities. 

8 Conclusions 

Let us summarize. We have succeeded in obtaining a large body of information about a 
deterministic system by using replica symmetry theory. We have defined a deterministic, 
quite complex model, and in first we have studied a simple approximation. We have 
shown that it is easy to reproduce such simple approximation by using replica theory. We 
have resummed the high temperature expansion of the model, and we have shown that 
indeed replica theory allows to solve the model in the whole high T region. We have found 
indications about the nature of the transition regime, but we have not been able to describe 
in detail the transition point and the low T phase. 
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In order to get the bulk of our analytical results we have written a disordered model, 
where we have substituted the Fourier transform with a generic unitary transformation 
(after some thinning of degrees of freedom). The two models coincide at high temperature, 
but they do (very probably) differ at low temperature. The deterministic model has (very 
probably) zero energy density at zero temperature, while the second one has a ground 
state energy density equal to .025. Still, we have to note that if for generic values of N 
(non good primes, where we know we get a zero energy density) the deterministic system 
would admit a ground state with energy equal to .025iV, we could appreciate the effect 
only for iV very large, of the order of 200, while we have been able to solve the model only 
up to N = 38. We cannot exclude that in the deterministic model the energy density is 
indeed non-zero for generic values of N, or even that for different choices of N (of non zero 
measure) one could get different behaviors. 

We believe that the use of replica field theory for studying systems without quenched 
noise is a very promising tool, which will be able to lead to precise results both in the high 
and in the low temperature phase. Systems without built-in disorder can have a complex 
landscape, and one can use replica theory to understand it. 
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